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ABSTRACT 

The purpose of this thesis was to present the procedure 
and techniques used to select the fourth annual recipient of 
the Rear Admiral John J. Shieffelin Award for Excellence in 
Teaching. The data and results were analyzed and compared 
with the results from the previous year. Findings indicate 
that the best teacher in each of the eleven academic depart- 
ments is being selected but that distribution of the eleven 
within the top twenty positions occurs randomly. 

Recommendations were made for changes in the present 
system should it continue in use and an additional 
recommendation was made for the adoption of a new method of 
selection based on the use of student questionnaires. 
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I 



INTRODUCTION 



In May 1969, the Superindendent of the U.S. Naval Post- 
graduate School directed that a committee be formed each 
year from among the faculty to select the recipient of an 
excellence in teaching award to be known as the Rear Admiral 
John J. Shieffelin Award. The committee was to be composed 
of a chairman, a secretary, and five members, all of whom 
would be chosen to represent a variety of backgrounds and 
curricula. In order to retain a degree of continuity within 
the committee, only four of its members would be replaced 
each year. 

The 1973 committee consisted of the following faculty 
members: 



G.J. 


Hokenson 


- Chairman 


N. Plotkin 


- Secretary 


D.E. 


Harrison 


- Member 


H.J. 


Zweig 


- Member 


J.N. 


Dyer 


- Member 


R. Stolfi 


- Member 


H.J. 


Larson 


- Member 



The following guidelines for the selection process were 
adopted by the committee: 

1. All faculty members who taught two or more course 
segments in 1972 were eligible to receive the award with 
the exception of members of the selection committee, curric- 
ular and liaison officers, and previous award winners. 
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2. The voting population would consist of all current 
students, faculty, curricular officers and the Naval officer 
alumni who were graduated in 1971. 

3. Participation in the voting would be on a voluntary 
ba sis. 

4. Care and discretion would be exercised to insure 
that no ranking of candidates was published. 

5. For the ballot to be valid, the voter must indicate 
on the candidate list at least five members of the faculty 
with whom he is sufficiently acquainted to make a judgment. 

6. Should the committee be unable to decide upon a 
single dominant winner, equal multiple awards would be 
presented not to exceed three in number. 

In order to maintain complete obj'ectivity among the 
selection committee it was decided that handling of all 
ballots and collation of all data would be performed by a 
graduate student who would then submit the results to the 
committee for its selection. The winner's name would remain 
secret until the award was presented at the June 1973 gradu- 
ation exercises. 
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II 



THE BALLOT 



A. FORMAT 

The ballot adopted by the committee for this year's 
polling was similar to those used in previous years but in- 
cluded minor modifications based on recommendations made the 
previous year. Students, faculty, and curricular officers 
each received a ballot and return envelope to which was 
attached a cover sheet which explained the purpose of the 
award and provided instructions on completing the ballot. 

In addition to the ballot and cover sheet, alumni received 
an additional cover letter from the Superintendent.^ 

The ballot was composed of four parts. Part A consisted 
of information useful for gathering statistics concerning 
voter characteristics. The voter was asked to identify his 
voter category, branch of service, military rank and curric- 
ular area if military or a civilian student; if a member of 
the faculty his- rank and department were to be indicated. 

.. Part B consisted of three blanks to be used in indicat- 
ing first, second, and third choices for the award using the 
four-digit identification number specified in Part C. 

Part C consisted of the list of all eligible faculty 
members. Members were listed in alphabetical order within 
departments and each name was preceded by a four-digit 

^ A sample ballot, cover letter, and instruction sheet 
are included in Appendix A. 
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identification number. The number of each faculty member 
with whom the voter was academically well acquainted was to 
be circled. From this field of selected individuals, the 
voter was then to select from one to three nominees and 
place their identification numbers in the blanks provided 
in Part B. 

Part D was an optional area in which the voter could 
provide remarks for supporting his first place nomination. 

B. BALLOT DISTRIBUTION 

Ballots were distributed to most students by placing an 
empty ballot in each student mail center box. NMSC students 
received ballots in the classroom. Alumni who were gradu- 
ated in 1971 were selected to participate in the voting and 
their names and addresses were obtained from a data tape 
maintained in the computer facility. Faculty member ballots 
were placed in faculty mail center boxes within each curric- 
ulum office. Completed ballots were placed in the return 
envelopes provided and mailed to Code 55 BAL. When received, 
the ballots were forwarded to a central location in the 
Operations Analysis Department. 

C. BALLOT VALIDATION 

The validation process consisted of insuring that the 
voter's signature was on the envelope and that the identifi- 
cation numbers of at least five faculty members in Part C 
were circled. If the envelope was unsigned or less than 
five faculty members in Part C were identified, the ballot 
was considered void and eliminated from further consideration. 
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Write-in votes in Part B were not considered. If Part B 



consisted of only write-in votes the ballot was considered 
void. If Part B consisted of a combination of write-in 
votes and valid identification numbers, the write-in votes 
were ignored. If an identification number appeared more 
than once in Part B, only its first appearance was counted. 
Each valid ballot was given a four digit identification 
number for ease of handling and future reference. 

Of the 1292 ballots returned, 335 were void, which is a 
larger percentage than occurred in 1972. The number of void 
ballots in each voter category and the reasons for disquali- 
fication are as follows: 



Failure to identify 5 faculty members 
Failure to complete Part B 
Completed Part B with write-in votes 
Received too late' to be processed 
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15 
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41 
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11 
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0 
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54 
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D. TRANSFERRING THE DATA TO COMPUTER TAPE 



Upon completion of the validation process, the informa- 
tion on each valid ballot was transferred to an IBM card in 
order that it could be processed by a series of prepared 
computer programs. The first of these was a COBOL routine 
called '’Transfer*' which checked each IBM card for possible 



A listing of "Transfer” is included in Appendix B. 
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TOTAL 



errors. The most frequent source of error would naturally 
arise from a typographical mistake in one of the four-digit 
faculty identification numbers. These numbers were assigned 
with this fact in mind and they were specifically devised so 
that a computer routine could be used to easily check their 
accuracy. Each instructor on the ballot was assigned a 
three-digit number which formed a vector. This vector was 
then multiplied by a fixed weighting vector to form an inner 
product, the last digit of which formed the fourth digit of 
the final identification number. For example, professor 
number 629, when multiplied by the weighting vector yields: 

/3 



( 6 2 9 ) 



18+10+9 



37 



\ 1 - 



Thus, the final identification number would be 6297. 

When an error was detected, ’’Transfer** identified the 
error and the ballot on which it occurred in order that it 
could be corrected and resubmitted. Those ballots found to 
be error free were transferred to a magnetic tape for 
further processing. This procedure was continued until all 
ballots were transferred to the tape. 
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III. STATISTICAL ANALYSIS 



A. POPULATION CHARACTERISTICS 

Table I compares voter response within each voter cate- 
gory with that response received in 1972. 



Table I. VOTER RESPONSE 

# ELIGIBLE # BALLOTS % RETURNED % CHANGE OVER 
CATEGORY VOTERS RETURNED FROM ELIGIBLE PREVIOUS YEAR 



Student 


1572 


764 


48.5 


+ 2.5 


Alumnus 


747 


407 


54.5 


-12.7 


Faculty 


305 


109 


35.8 


- 6.1 


Curr.Off . 


17 


12 


70.5 


+33.0 



The figures indicate that alumnus and faculty response 
percentages have decreased from the previous year while 
student response has increased slightly and the percentage 
of curricular officers responding has increased substantial- 
ly. However, the valid voter response figures shown in 
Table II indicate that this slight increase in the number of 
overall responses was more than negated by the considerable 
increase in void ballots received, (335 vs. 148). It 
appears that additional effort must be made to not only 
encourage increased voter response, but also to insure that 
ballots are filled out correctly. 





Table II 


. VALID 


VOTER 


RESPONSE 




CATEGORY 


# ELIGIBLE 


# VALID 


% 


VALID 


% CHANGE OVER 




VOTERS 


BALLOTS 


FR(>1 


ELIGIBLE 


PREVIOUS YEAR 


Student 


1572 


554 




35.2 


- 6.1 


Alumnus 


747 


314 




42.1 


-19.6 


Faculty 


305 


83 




27.2 


- 7.2 


Curr.Off. 


17 


6 




35.3 


+ 4.0 
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B. DISTRIBUTION OF 

After all ballots had been placed on magnetic tape, a 

3 

second COBOL program, "Prof sort" , was run which rearranged 
the data from ballot format into a statistical record for 
each faculty member. The program then identified the fre- 
quency distribution of M^, the number of faculty members 
"t h 

known by the i voter. Table III presents a frequency 

table of M. . The mean of Jd. •= 16.1 with a standard devia- 
1 

tion of 9.7. An interesting fact to note is that in all 
cases where a voter identified 55 or more faculty members 
with whom he was sufficiently familiar to judge as an in- 
structor, the voter was himself a member of the faculty. 



Table III. FREQUENCY TABLE OF 



CELL 


FREQUENCY 


5-9 


236 


10-14 


266 


15-19 


181 


20-24 


137 


25-29 


80 


30-34 


28 


35-39 


14 


40-44 


3 


45-49 


5 


50-54 


2 


55-59 


1 


60-64 


1 


65-69 


0 


70-74 


1 


75-79 


0 


80-84 


0 


85-89 


0 


90-94 


0 


95-99 


1 


100-104 


0 


105-109 


0 


110-114 


1 


115-120 


2 



3 



A listing of "Profsort" is included in Appendix B. 




in \ 





C. DISTRIBUTION OF Nj^ 

Once "Profsort” had established a distribution of and 

compiled a statistical record for each faculty member on a 

4 

new magnetic tape, a third COBOL program, "Scorsort” was 

run which provided a frequency distribution of Nj^, the 

"t h 

number of voters who knew the k professor. The mean of Nj^ 
was determined to be 53,4 with a standard deviation of 50.7. 
Table IV is a frequency table of 



Table IV. 


FREQUENCY TABLE OF Nj^ 


CELL 


FREQUENCY 


1-20 

21-40 

41-60 

61-80 

81-100 

101-120 

.121-140 

141-160 

161-180 

181-200 


28 

88 

74 

39 

33 

10 

10 

0 

1 

1 



D. DETERMINATION OF Sj^ 

In addition to calculating Nj^, ’’Scorsort*' calculated a 
numerical score for each faculty member and provided the 
following statistics: 

Xik = Number of 1st place votes received by professor k 

X2k “ Number of 2nd place votes received by professor k 

^3k ~ Number of 3rd place votes received by professor k 

Scores were calculated in the following manner: 

A weighting vector W = (4,2,1) was multiplied by 

^ A listing of "Scorsort" is included in Appendix B. 
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the population that knew him; i=l,2,3; k=l,2 



} • • • 



Score 



(Vlk V2k V31, ) 




For example, suppose a faculty member were known by 40 
students and received four first place votes, two second 
place votes and one third place vote. His score would be 
calculated as follows: ^ , 



Table V presents the scores in descending order with the 
corresponding values of Nj^, ^2k’ ^3k each 

faculty member. 

E. DOMINANCE 

In calculating the numerical scores of each candidate, 
it was decided that a first place vote should be worth more 
than a second place vote which should be worth more than a 
thrid place vote. Consequently, a weighting vector W = 
(4,2,1) was chosen for use and the scores were calculated 
using these figures. However, it might be possible that 
some other W than the one used could be chosen which retained 
the relationship w^^w^w^ but this would result in a differ- 
ent ordering of faculty member scores. 

Recall that the score of teacher K, S, , was calculated 

k 

by multiplying the weighting vector (W) by V.. , the vector 

lie 



^Ik 40 ’ ^2Vi 40 ’ ^3k 40 
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Table V. 


SCORSORT 


SUMMARY 






k 


S, 


N. 


X 


X 


X 




k 


k 


Ik 


2k 


3k 


1 


1.93333 


30 


9 


9 


4 


2 


1,87179 


39 


15 


5 


3 


3 


1,65385 


26 


7 


6 


3 


4 


1.64103 


39 


12 


4 


8 


• 


1.60448 


134 


35 


30 


15 


• 


1.59459 


37 


9 


8 


7 


• 


1.58065 


93 


24 


19 


13 




1,48438 


64 


20 


6 


3 




1.42157 


102 


27 


14 


9 




1.41912 


136 


34 


22 


13 




1.35897 


39 


9 


6 


5 




1.32653 


49 


12 


5 


7 




1.31250 


48 


10 


6 


11 




1.25806 


31 


8 


2 


3 




1.22222 


36 


7 


6 


4 




1.20833 


72 


16 


8 


7 




1 . 20000 


20 


3 


5 


2 




1.17391 


23 


5 


3 


1 




1.12360 


89 


19 


8 


8 




1.11111 


45 


8 


7 


4 




1.10638 


47 


8 , 


8 


4 


• 


1.10219 


137 


25 


18 


15 


• 


1.08000 


50 


8 


10 


2 


• 


1.04167 


48 


10 


4 


2 


25 


1.03226 


31 


6 


2 


4 
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Table V. SCORSORT SUMMARY (continued) 



k 




N 

k 


><! 

H 


X 

2k 


X 

3k 


26 


1.02778 


36 


7 


3 


3 


• 


1.02222 


45 


9 


. 2 


6 


• 


1 . 00000 


55 


8 


9 


5 


• 


0.97087 


103 


18 


9 


10 




0.93939 


66 


8 


12 


6 




0.. 93939 


33 


5 


4 


3 




0.93750 


48 


8 


5 


3 




0.92929 


99 


12 


18 


8 




0.91803 


122 


21 . 


9 


10 




0.91429 


105 


17 


10 


8 




0.91139 


79 


10 


12 


8 




0.87952 


83 


10 


14 


. 5 




0.87805 


41 


6 


5 


2 




0.84211 


19 


2 


4 


0 




0.82759 


29 


4 


3 


2 




0.82143 


56 


8 


6 


2 




0.80435 


46 


5 


4 


9 




0.80000 


75 


10 


8 


4 




0.79487 


39 


5 


4 


3 




0.79310 


29 


5 


1 


1 




0.78947 


95 


13 


6 


11 


• 


0.76364 


55 


4 ‘ 


9 


8 


• 


0.75676 


37 


3 


6 


4 


• 


0.74074 


27 


4 


2 


0 


50 


0.73529 


34 


5 


1 


3 
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Table V. SCORSORT SUMMARY 


(continu 


ed) 




k 


s 


N 


X 








k 


k 


Ik 


2k 


3k 


51 


0.72527 


91 


11 


7 


8 


• 


0.71429 


84 


7 


10 


12 


• 


0.71233 


73 


9 


5 


6 


• 


0.70370 


27 


3 


3 


1 




0.68966 


58 


8 


3 


2 




0. 68750 


64 


7 


7 V 


2 




0.67500 


40 


4 


2 


7 




0.66667 


12 


2 


0 


0 




, 0.66000 


50 


4 


7 


3 




0.63636 


22 


1 


4 


2 




0.63158 


57 


7 


2 


4 




0.62590 


139 


11 


12 


19 




0.62500 


24 


2 


2 


3 




0.60317 


63 


5 


7 


4 




0.60000 


50 


4 


4 


6 




0. 60000 


20 


1 


4 


0 




0.58947 


95 


9 


5 


10 




0.58537 


41 


4 


3 


2 




0.58228 


79 


8 


5 


4 




0.57971 


69 


7 


4 


4 




0.57447 


47 


2 


8 


3 


• 


0.56757 


37 


4 


2 


1 


• 


0.56716 


134 


10 


13 


10 


• 


0.56098 


41 


4 


3 


1 


75 


0.55882 


34 


3 


2 


3 



17 



Table V. SCORSORT SUMMARY (continued) 



k 






^Ik 


^2k 


^3k 


76 


0.54839 


31 


2 


3 


3 


• 


0.54762 


42 


4 


3 


1 


• 


0.54286 


35 


3 


3 


1 


• 


0.54286 


35 


3 


1 


5 




0.54167 


48 


4 


4 


2 




0.50000 


104 


9 


4 


8 




0.50000 


40 


3 


3 


2 




0.50000 


34 


2 


3 


3 




0.50000 


28 


2 


1 


4 




0.49057 


53 


2 


6 


6 




0.47917 


96 


6 


8 


6 




0.47458 


59 


3 


6 


4 




0.46988 


83 


6 


4 


7 




0.46875 


32 


3 


1 


1 




0.46269 


67 


4 


4 


7 




0.46154 


39 


3 


2 


2 




0.45833 


48 


1 


7 


4 




0.43750 


64 


5 


1 


6 




0.43750 


48 


3 


3 


3 




0.43182 


44 


2 


4 


3 




0.42353 


85 


4 


8 


4 


• 


0.42308 


78 


5 


5 


3 


• 


0.42105 


19 


0 


4 


0 


• 


0.41026 


39 


2 


2 


4 


100 


0.40278 


72 


3 


6 


5 
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Table V. SCORSORT SUMMARY (continued) 



k 




\ 


X 

Ik 


X 

2k 


X 

3k 


101 


0.40000 


25 


2 


1 


0 


• 


0.39344 


61 


3 


4 


4 


• 


0.38554 


83 


3 


8 


4 


• 


0.38462 


26 


1 


2 


2 




0.38272 


81 


3 


4 


11 




0.38158 


76 


4 


• 6 


1 




0.38095 


63 


3 


2 


8 




0.37931 


29 


2 


1 


1 




0.36667 


30 


1 


2 


3 




0.36585 


82 


5 


2 


6 




0.36364 


44 


3 


2 


0 




0.36111 


36 


2 


2 


1 




0.35714 


28 


2 


1 


0 




0.35714 


28 


1 


2 


2 




0.35294 


102 


2 


7 


14 




0.35294 


34 


1 


3 


2 




0.34848 


66 


2 


6 


3 




0.34211 


38 


2 


1 


3 




0.34091 


44 


2 


3 


1 




0.34043 


47 


2 


3 


2 




0.33663 ' 


101 


4 


3 


12 


• 


0.33333 


33 


2 


1 


1 


• 


0.33333 


27 


1 


2 


1 


• 


0.33333 


24 


2 


0 


0 


125 


0.32653 


49 


3 


2 


0 
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Table V. SCORSORT SUMMARY (continued) 



k 




N 

k 


X 

Ik 


X 

2k 


X 

3k 


126 


0.32609 


46 


1 


4 


3 


• 


0.32500 


40 


1 


3 


3 


• 


0.32500 


40 


2 


2 


1 


• 


0.32203 


59 


2 


3 


5 




0.31250 


32 


2 


0 


2 




0.30488 


82 


3 


4 


5 




0.30000 


10 


0 


1 


1 




0.29730 


37 


0 


5 


1 




0.29730 


37 


1 


2 


3 




0.29412 


34 


1 


2 


2 




0.28125 


96 


3 


5 


5 




0.28000 


50 


1 


3 


4 




0.27869 


61 


0 


5 


7 




0.27835 


97 


5 


3 


1 




0.27778 


72 


2 


4 


4 




0.27551 


98 


2 


6 


7 




0.27439 


164 


6 


8 


5 




0.26596 


94 


3 


4 


5 




0.26316 


38 


1 


2 


2 




0.25974 


77 


2 


3 


6 




0.25714 


105 


3 


6 


3 


• 


0.25641 


39 


2 


1 


0 


• 


0.25490 


51 


3 


0 


1 


• 


0.25000 


84 


3 


4 


1 


150 


0.25000 


40 


2 


1 


0 
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Table V. SCORSORT SUMMARY (continued) 



k 




N 

k 


X 

Ik 


X 

2k 


X 

3k 


151 


0.24390 


41 


1 


2 


2 


• 


0.22581 


124 


4 


4 


4 


• 


0.22222 


54 


2 


2 


0 


• 


0.22222 


54 


1 


2 


4 




0.22222 


36 


0 


3 


2 




0.22222 


18 


1 


0 


0 




0.22000 


50 


0 


3 


5 




0.21951 


41 


1 


2 


1 




0.21875 


64 


2 


2 


2 




0.21795 


78 


3 


1 


3 




0.21429 


28 


0 


2 


2 




0.21154 


52 


1 


3 


1 




0.21053 


19 


0 


1 


2 




0.20755 


53 


1 


2 


3 




0.20690 


29 


1 


0 


2 




0.20661 


121 


1 


8 


5 




0.20588 


34 


0 


2 


3 




0.20482 


83 


3 


2 


1 




0.20000 


95 


2 


4 


3 




0.20000* 


80 


3 


1 


2 




0.20000 


40 


2 


0 


0 


• 


0.19853 


136 


3 


7 


1 


• 


0.19737 


76 


2 


1 


5 


• 


0.19444 


36 


1 


1 


1 


175 


0.19231 


26 


1 


0 


1 
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Table V. SCORSORT SUMMARY 


(continued) 




k 


s. 


N 


X 








k 


k 


Ik 


2k 


3k 


176 


0.19048 


84 


3 


1 


2 


• 


0.18367 


49 


1 


2 


1 


• 


0.17241 


87 


2 


3 


1 


• 


0.17073 


41 


0 


3 


1 




0.16667 


12 


0 


1 


0 




0. 16396 


61 


1 


2 


2 




0.16129 


31 


0 


1 


3 




0. 16129 


31 


1 


0 


1 




0.16129 


31 


1 


0 


1 




0.15854 


82 


0 


3 


7 




0.15152 


33 


0 


2 


1 




0.15000 


20 


0 


1 


1 




0.14773 


88 


1 


2 


5 




0.14667 


75 


2 


0 


3 




0.14545 


55 


0 


3 


2 




0. 14035 


57 


1 


1 


2 




0.13793 


29 


0 


2 


0 




0.13793 


29 


1 


0 


0 




0.13636 


22 


0 


1 


1 




0.13333 


45 


1 


1 


0 




0.13333 


30 


0 


2 


0 


• 


0.13043 


23 


0 


1 


1 


• 


0.13021 


192 


3 


4 


5 


• 


0.12903 


31 


1 


0 


0 


200 


0.12000 


25 


0 


1 


1 
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Table V. SCORSORT SUMMARY (continued) 



k 


S 

k 


N 

k 


X 

Ik 


X 

2k 


X 

3k 


201 


0,11765 


51 


. 0 


2 


2 


• 


0.11429 


35 


1 


0 


0 


• 


0.11250 


80 


1 


1 


3 


• 


0.11111 


99 


1 


2 


3 




0.11111 


81 


1 


2 


1 




0,11111 


63 


0 


3 


1 




0.11111 


45 


0 


1 


3 




0.11111 


45 


0 


2 


1 




0.11111 


36 


1 


0 


0 




0.11111 


27 


0 


1 


1 




0.11111 


9 


0 


0 


1 




0.10870 


46 


0 


1 


3 




0.10417 


48 


0 


2 


1 




0.09756 


41 


1 


0 


0 




0.08889 


45 


1 


0 


0 




0.08824 


68 


0 


3 


0 




0.08333 


84 


0 


3 


1 




0.08333 


72 


1 


0 


2 




0.08197 


61 


1 


0 


1 




0.08197 


61 


1 


0 


1 




0.07843 


51 


0 


1 


2 


• 


0.07692 


52 


0 


2 


0 


• 


0.07547 


106 


0 


3 


2 


• 


0.07143 


28 


0 


1 


0 


225 


0.07143 


14 


0 


0 


1 
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Table V. SCORSORT SUMMARY (continued) 



k 




N 

k 


X 

Ik 


X 

2k 


X 

3k 


226 


0.06897 


29 


0 


0 


2 


• 


0.06818 


44 


0 


1 


1 


• 


0.06780 


59 


0 


2 


0 


• 


0.06522 


92 


0 


2 


2 




0.06522 


46 


0 


1 


1 




0.06250 


16 


0 


0 


1 




0.06122 


49 


0 


1 


1 




0.06098 


82 


0 


1 


3 




0.06000 


50 


0 


1 


1 




0.05882 


34 


0 


1 


0 




0.05714 


35 


0 


1 


0 




0.05263 


19 


0 


0 


1 




0.05263 


19 


0 


0 


1 




0.05128 


39 


0 


0 


2 




0.05000 


60 


0 


0 


3 




0.04444 


45 


0 


0 


2 




0.03704 


54 


0 


0 


2 




0.03390 


59 


0 


0 


2 




0.03333 


30 


0 


0 


1 




0.03333 


30 


0 


0 


1 




0.03030 


66 


0 


1 


0 


• 


0.03030 


33 


0 


0 


1 


• 


0.02941 


68 


0 


0 


2 


• 


0.02532 


79 


0 


1 


0 


250 


0.02273 


44 


0 


0 


1 
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Table V. SCORSORT SUMMARY 


(cont 


inued ) 




k 


s 


N 


X 


X 


X 




k 


k 


Ik 


2k 


3k 


251 


0.02128 


47 


0 


0 


1 


• 


0.01639 


122 


0 


1 


0 


• 


0.01613 


62 


0 


0 


1 


• 


0.01124 


89 


0 


0 


1 




0.01099 


91 


0 


0 


1 




0.00952 


105 


0 


0 


1 




0.00855 


117 


0 


0 


1 




0.00000 


68 


0 


0 


0 




0.00000 


64 


0 


0 


0 




0.00000 


58 


0 


0 


0 




0.00000 


58 


0 


0 


0 




0.00000 


55 


0 


0 


0 




0.00000 


49 


0 


0 


0 




0.00000 


48 


0 


0 


0 




0.00000 


46 


0 


0 


0 




0.00000 


43 


0 


0 


. 0 




0.00000 


39 


0 


0 


0 




0.00000 


38 


0 


0 


0 




0.00000 


34 


0 


0 


0 




0.00000 


32 


0 


0 


0 




0.00000 


28 


0 


0 


0 


• 


0.00000 


27 


0 


0 


0 


• 


■ 0 . 00000 


25 


0 


0 


0 


• 


0.00000 


25 


0 


0 


0 


275 


0.00000 


23 


0 


0 


0 
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Table V. SCORSORT SUMMARY (continued) 



k 


S 


N 


X 


X 


X 




k 


k 


Ik 


2k 


3k 


276 


0.00000 


22 


0 


0 


0 


• 


0.00000 


21 


0 


0 


0 


• 


0.00000 


19 


0 


0 


0 


• 


0.00000 


19 


0 


0 


0 




0.00000 


17 


0 


0 


0 




0.00000 


16 


0 


0 


0 




0 . 00000 


16 


0 


0 


0 




0 . 00000 


14 


0 

r 


0 


0 




0.00000 


14 


0 


0 


0 




0 . 00000 


12 


0 


0 


0 




0.00000 


11 


0 ’ 


0 


0 


• 


0.00000 


7 


0 


0 


0 


• 


0.00000 


5 


0 


0 


0 


• 


0.00000 


1 


0 


0 


0 


290 


0.00000 


1 


0 


0 


0 
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place votes awarded to teacher K from 



"t h 

of the fraction of i 

the population that knew him, i=l,2,3; k=l 

in order to have S, > S, , the relationship 

k k' 

"2 ''2k '“3''3k > "l''lk’-'- ”2''2k' 



2, . . . Therefore, 
+ , K / K' 



must hold. Rearranging yields. 



w (V -V . ■) + w (V -V . ■) + w (V -V .) >0 
1^ Ik Ik*'' 2' 2k 2k*'' 3^ 3k 3k*'' 

Now, if all values of V., - V., , > 0, with at least one 

* ik ik' — ’ 

value in which the equality does not hold, then Sj^> Sj^, 
regardless of the value of W and teacher K' can be elimina- 
ted. An even stronger condition would be met if all values 

of V., - V., , >“0. This condition is called absolute 

ik ik' 

dominance. 

For example, suppose three teachers have the following 
values of V: 



T 


V 


V 


V 


k 


Ik 


2k 


3k 


1 


.7825 


.5377 


.4114 


2 


.7519 


.5211 


.4081 


3 


.7263 


.3862 


.5622 



T^ absolutely dominates T^, but neither T^^ nor T^ is 
absolutely dominated. 

Another form of dominance is called complete dominance. 

This would occur when the condition w^>l must be 

violated in order for a particular instructor to win. In 

the above example, if all three place votes were given 

equal weights, the extreme example which still maintains the 

relationship w^i w > w^ , T^ would still have a higher score 
t' 1— 2~ 3* 1 ^ 

than T^. However, if a weighting vector were allowed in 
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which a third place vote is worth more than either a first 



or a second place vote, would have a higher score than 
T . Since this is the only case in which T can win, we say 
that is completely dominated by and can also be elim- 
inated from the competition. 

In order to invoke these conditions of dominance and 
hence further reduce the number of possible recipients of 
the award, a FORTRAN program called "Dominance”^ was run on 
those faculty members having the top 25 scores from 
"Scorsort". The results are listed in Table VI. The AD and 
CD columns list the results of the absolute dominance and 
complete dominance tests, respectively. A 1 indicates Tj^ 
is dominated and a 0 indicates he is not. As can be noted, 
the absolute dominance test reduced the number of possible 
recipients to 6 and the complete dominance further reduced 
this number to 3. 



F. PAIRED COMPARISONS 



Since all students were not exposed to the same instruc- 
tors, it was felt that it might be of interest to select 
combinations of two of the three undominated instructors 
and compute their scores using only the votes of those 
voters who indicated knowing them both. In this way the 
scores could be compared to substantiate or dispute the 
relative rankings determined using the votes of the entire 



5 



A 



listing 



of ’’Dominance”, is 



included in Appendix B. 
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■ 5 . 



4 



1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

21 

22 

23 

24 

25 



0 

0 

1 

0 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 



Table VI. DOMINANCE TEST RESULTS 



V 

Ik 


V 

2k 


^3k 


AD 


30000 


. 30000 


.13333 


0 


38461 


.12820 


.07692 


0 


26923 


.23076 


.11538 


1 


30769 


.10256 


.20512 


0 


26119 


.22388 


.11194 


1 


24324 


.21621 


.18918 


O 


25806 


.20430 


.13978 


0 


31250 


.09375 


.04687 


1 


26470 


.13725 


. 08823 


1 


25000 


.16176 


.09558 


1 


23076 


.15384 


.12820 


1 


24489 


.10204 


.14285 


1 


20833 


.12500 


.22916 


0 


25806 


.06451 


.09677 


1 


19444 


.16666 


.11111 


1 


22222 


.11111 


.09722 


1 


15OO0 


.25000 


. 10000 


1 


21739 


. 13043 


.04347 


1 


21348 


.08988 


.08988 


1 


17777 


.15555 


.08888 


1 


17021 


.17021 


.08510 


1 


18248 


.13138 


.10948 


1 


,16000 


. 20000 


. 04000 


1 


,20833 


.08333 


.04166 


1 


,19354 


.06451 


.12903 


1 
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was run 



population. A FORTRAN program called ’’Comparison” 

and the scores were recomputed for T, vs. , T, vs. T^, and 

1 2 ’ 1 4 ’ 

vs. T^. It was determined, however, that T, and had 
2 4 ’’14 

no voters in common and there did not exist a valid basis 
for comparison. 



A listing of ’’Comparison” 



is included in Appendix B. 
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IV 



THE SELECTION 



Upon completion oT the aforementioned score computations 
and tests the following information was presented to the 
committee for their consideration and selection of a 
winner : 

1. Results of the score calculations 

2. The number of 1st, 2nd and 3rd place votes received 
by the top 25 scorers 

3. Results of the dominance tests for the top 25 
scorers 

4. Results of the paired comparisons 

5. Extracts of the comments sections of ballots 
selecting T^ , T^ , or T^ in first place. 

After discussion and deliberation, the committee 
unanimously decided to recommend to the Provost that the 
award be divided equally among teachers T^^, T 2 , and T^. 

The final decision of the Provost, however, was to present 
the award to Professor M. F, Reynolds of the Department of 
Physics and Chemistry. 
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V. FURTHER ANALYSIS 



In order to determine if any one academic department was 
predominant among the top 50 or bottom 50 scorers, the dis- 
tribution for each department was determined and the 
percentage, involved of each department was calculated. 
Tables VII and VIII give the results for 1972 and 1973. 



Table VII. DISTRIBUTION OF 
Dept . 

Electrical Engr. 

Aeronautics 
Aviation Safety 
Govt, and Humanities 
Mathematics 
Mechanical Engr. 

Meteorology 

Oceanography 

Ops. Rsch. & Admin. Sci. 

Physics & Chem. 

NMSC 



TOP 


50 SCORERS - 


1972 


and. 1973 


1972 

Number and % 
Of Department 


1973 

Number and % 
Of Department 


5 


(11.6%) 


6 


(15.8%) 


3 


(16.7%) 


4 


(19.1%) 


1 


(25.0%) 


1 


(20.0%) 


2 


(22.2%) 


1 


(11.1%) 


8 


(18.2%) 


8 


(18.6%) 


4 


(28.6%) 


4 


(23.7%) 


3 


(25.0%) 


4 


(28.6%) 


2 


(14.3%) 


1 


( 7.1%) 


11 


(14.7%) 


14 


(17.1%) 


6 


(13.3%) 


3 


( 8.8%) 


5 


(33.3%) 


4 


(30.8%) 
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Table VII. DISTRIBUTION OF BOTTOM 50 SCORERS - 1972 & 1973 



Dept , 



1972 

Number and % 
Of Department 



1973 

Number and % 
Of Department 



Electrical Engr . 


7 


(16.3%) 


8 


(21.0%) 


Aeronautics 


2 


(11.1%) 


4 


(19.1%) 


Aviation Safety 


1 


(25.0%) 


2 


(40.0%) 


Govt, and Humanities 


0 




1 


(11.1%) 


Mathematics 


3 


( 6.8%) 


8 


(18,6%) 


Mechanical Engr. 


2 


(14.3%) 


1 


( 5.9%) 


Meteorology 


4 


(33.3%) 


3 


(21.4%) 


Oceanography 


5 


(35.7%) 


3 


(21.4%) 


Ops. Rsch. & Admin. Sci. 


17 


(22.7%) 


14 


(17.1%) 


Physics & Chem. 


7 


(15.6%) 


5 


(14.7%) 


NMSC 


2 


(13.3%) 


2 


( 9.2%) 


It is interesting to 


note that the top 10 


scorers of 



1972 represented 9 different departments and the top 10 
scorers of 1973 represented 7 different departments. This 
would appear to indicate that. the selection process was 
successfully selecting the top man in each department but 
that placement within the top 10 to 20 positions occurred on 
a random basis. In order to further investigate this 
possibility, a Spearman Rank-Order Correlation (rho) test 
was performed using the rankings of the top man in each 
department in 1972 versus the rankings of the top man in 
those same departments in 1973. 
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I 

i 

t 

1 



DEPT. DEPARTMENT RANK DEPARTMENT RANK 



Meteorology 


IN 1972 
1 


IN 1973 
11 


Mech. Engr. 


2 


3 


Physics & Chem. 


3 


2 


Elec. Engr. 


4 


4 


Avn. Safety 


5 


6 


Aeronautics 


6 


8 


Mathematics 


7 


7 


Ops. Rsch. and Admin. Sci. 


8 


1 


Govt, and Humanities 


9 


9 


NMSC 


10 


5 


Oc eanog ra phy 


11 


10 


The statistic rho = 1 - — 




was computed where 



N(N -1) 



D = difference in ranking of each dept, in 1972 and 1973 
N = number of departments 

6Zd^ = 1092 N(N^-l) = 1320 

rho = 1 - .828 = .172 

Testing the significance of rho, i.e., the hypothesis 

that rho = 0, the t-statistic with 9 degrees of freedom is 

calculated to be / „' 

t = rhoi / — - .169 
" l-rho'^ 

which is not significant at the .05 level of significance 
and the hypothesis is not rejected. This would appear to 
indicate that the rankings of the top men in each department 
in 1972 and 1973 were randomly distributed within the first 
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twenty scores. Further substantiation of this hypothesis 
can be seen by noting the small number of voters that the 
top 20 scorers have in common. Table IX is a matrix 
depicting the number of voters in common among the top 20 
scorers in 1973. It can easily be seen that in most cases 
where teachers are in different departments, the number of 
students in common is quite small. In order to facilitate 
comparison, the following is a list of those teachers among 
the top 20 who are in the same department: 

1, 5, 18 

2 , 8 

3, 11, 14 
6, 15 

9, 10, 19 
12, 17 



I 
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Table IX. NUMBER OF COMMON VOTERS AMONG TOP 20 SCORERS 1973 



0 2 0 
2 0 0 
0 0 0 

011 
5 2 0 
0 0 0 
0 5 2 

0 7 3 

0 6 1 
17 2 

0 6 17 

12 2 

13 0 

0 4 15 

0 0 0 
19 2 

0 12 
6 3 0 

2 7 4 

2 3 1 



0 5 0 0 

12 0 5 

10 0 2 
0 0 0 0 
O 0 6 17 

0 6 0 8 
O 17 8 0 

11 2 1 5 

16 14 

5 5 0 6 

12 0 3 

10 18 
O 1 O 12 
110 2 
O 7 32 7 

O 5 O 18 
0 2 0 1 
0 5 0 3 

0 3 0 3 

0 10 2 



0 0 10 1 
7 6 7 6 2 

3 1 2 17 2 

11 1 5 1 1 

2 6 5 2 0 

110 0 1 
5 4 6 3 8 

0 7 8 5 3 

7 0 27 6 5 

8 27 O 7 4 

5 6 7 0 5 

3 5 4 5 0 

0 0 2 2 0 

6 4 6 22 3 

0 0 10 0 

8 13 9 5 1 

2 1 1 4 14 

0 1110 

9 21 26 9 8 

3 19 18 3 1 



10 0 10 
3 4 0 9 1 

O 15 0 2 2 

0 10 0 0 
117 5 2 

O O 32 0 0 

12 2 7 18 1 

0 6 0 8 2 

0 4 O 13 1 

2 6 19 1 

2 22 0 5 4 

0 3 O 1 14 

0 0 0 3 0 

0 0 0 5 2 

0 0 0 1 0 

3 5 10 1 

0 2 0 1 0 

5 0 0 1 0 

O 5 0 16 2 

0 3 0 20 1 



6 2 2 
3 7 3 

0 4 1 

0 0 0 
5 3 1 

0 0 0 
3 3 2 

0 9 3 

1 21 19 

1 26 18 
19 3 

0 8 1 
5 0 0 

0 5 3 

0 0 0 

1 16 20 

0 2 1 
0 3 0 

3 O 19 
0 19 O 
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VI 



RECOMMENDATI ONS 



It is felt that the present system can be used effec- 
tively to select within each department that faculty member 
considered most proficient; however, as a means of further 
definitive selection, the present system is considered 
inadequate. The following two proposals are presented for 
consideration : 

A. CONTINUATION OF PRESENT SELECTION METHOD 

The present method can be continued as a means of 
selecting the top scorer in each department. The cash 
award which is normally presented to the winner can be used 
to purchase appropriate engraved plaques or other memora- 
bilia which could be presented to the 11 co-winners at the 
June graduation ceremonies. 

Should the present selection method be continued, the 
following modifications are recommended: 

1. Faculty members should not be permitted to vote. 
During the course of ballot verification numerous faculty 
members who were identified by their signatures on the 
outside envelope were found to have voted for themselves. 

No accurate figures were kept in this regard, but it is 
estimated that 25% - 35% of faculty member ballots fell 
into this category. 

The average number of eligible faculty identified 
in Part C of the ballot by faculty members was 25.8. These 
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figures include three faculty members who identified 119, 
115, and 114 persons in Part C. Excluding these three fig- 
ures from the calculations reduces the average number to 
22,5. Considering the fact that in most departments faculty 
members rarely have the opportunity to witness each other at 
work in the classroom, the figure of 22.5 appears to be 
quite high. This would indicate that personal rather than 
professional familiarity is being used as a criterion for 
filling out Part C. 

2. A cover letter from the Superintendent should be 
included with all distributed ballots. During the course 
of the year, numerous questionnaires of various types are 
distributed to students in their SMC boxes by other officer 
students attempting to use the responses for course require- 
ment studies or theses. Because of the large number 
involved, many of the questionnaires find their way to the 
SMC trash containers. Considering the fact that student 
response was less than 50%, it is felt that a large number 
of the unreturned ballots suffered a similar fate. A cover 
letter from the Superintendent, identical to that accompany- 
ing each alumnus ballot, will impress on each student that 
the ballot is of a semi-official nature and a matter in 
which the Superintendent has an interest and should increase 
student participation. 

3. The headings of Parts B and C of the ballot should 
be revised. Of the 335 disqualified ballots, 275 failed to 
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identify 5 faculty members in Part C. The instruction sheet 
accompanying each ballot explains the procedure to be fol- 
lowed, but no instructions for circling the identification 
numbers of at least 5 faculty members appears on the ballot 
itself. Furthermore, Part B should follow Part C in order 
to be in a logical sequence since Part C is performed prior 
to Part B, 

A suggested format for the headings of Parts B and C is 
as follows: 

PART B - LIST OF ELIGIBLE FACULTY (ALL FACULTY WHO HAVE 
TAUGHT IWO OR MORE COURSE SEGMENTS IN CALENDAR 
YEAR 1973 EXCEPT CURRICULAR AND LIAISON OFFI- 
CERS, MEMBERS OF THE SELECTION COMMITTEE AND 
PRIOR WINNERS) 

ENCIRCLE THE FOUR-DIGIT IDENTIFICATION NUMBER 
OF ALL THOSE WITH WHOSE TEACHING ABILITY YOU 
ARE SUFFICIENTLY ACQUAINTED TO MAKE A JUDGMENT. 
DO NOT CONTINUE TO PART C UNLESS YOU HAVE 
ENCIRCLED AT LEAST FIVE NUMBERS. 



PART C - NOMINATIONS (INSERT A FOUR-DIGIT FACULTY 

IDENTIFICATION NUMBER IN EACH BLANK). WRITE- 
IN VOTES ARE NOT ACCEPTABLE. 



4. The following four-digit identification numbers 

should be changed in order that the fourth digit conform to 

the method discussed in Part II, D of this paper: 

2552 to 2556 
5244 to 5249 
5200 to 5205 
5211 to 5216 
5222 to 5227 

5. A number of instructors who should have been 
included were inadvertently omitted from the ballot and 
conversely, the ballot contained the names of some ineligible 
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faculty members. A thorough check must be made to insure 
that all eligible faculty members are included. 

6. The designator for Professor under Faculty Rank 
should be PR in lieu of RP and the designator EE for 
Electrical Engineering should be included under Faculty 
Department . 

B. ADOPTION OF A NEW SELECTION SYSTEM 

In order to attempt to select the one best teacher in 
the school, it is recommended that the present system be 
replaced by one employing a new methodology. What is 
required is a system whereby faculty members can be judged 
by different populations on the basis of various teacher 
qualities or characteristics. If the scales for judgment 
were identical, all faculty members could then be compared 
on the basis of their total scores divided by the total 
number of evaluations. A problem inherent in this technique, 
however, is the selection of those descriptions of a teach- 
er's classroom behavior which are highly correlated to the 
student's overall concept of effective teaching. Examina- 
tion of the various forms used by schools throughout the 

nation to evaluate teacher performance indicates a lack of 

7 

agreement on what characterxstics are important. Conse- 
quently, work was done at the University of Washington by 
Grace M. French in an attempt to select those teacher 



French, G.M., College Students' Concept of Effective 
Teaching Determined by an Analysis of Teacher Ratings , Ph . D . 
Thesis, University of Washington, 1957, p. 2. 
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characteristics best suited to reflect what students con- 
sider important for teacher effectiveness. A student 
questionnaire was devised which consisted of 41 items 
gathered from forms in use throughout the country and each 
student was asked to judge his instructor on a five point 
scale on each of the items listed as well as to provide an 
overall judgment of the teacher. The 41 items were regarded 
as independent variables and the overall judgment as the 
dependent variable. It was then determined what relation- 
ship exists between the system of independent variables and 
the dependent variable; i.e., the relative contribution of 
each item to the overall judgment. This was measured as the 
product of B^r^^ where 

B. = regression weight for the i^ item 

th ® 

r. = validxty coefficient for the i item 
The top 25 items in the order of highest contribution are 
listed in Appendix C. 

It is recommended that a student opinion questionnaire 
be devised for use at the Naval Postgraduate School using 
the 25 items listed in Appendix C. Since each item varies 
in its contribution to overall judgment, a system of weights 
should be devised for each of the items in proportion to its 
relative value. A specified portion of class time at the 
end of each quarter could be allotted for completion of the 



Validity is defined in French, p, 25, as the corre- 
lation between a predictor and that which is being 
predicted. No further explanation of r. could be found. 



41 



questionnaire by all students and a score compiled for each 
faculty member which would be updated each quarter. In 
addition to selection of the annual excellence in teaching 
award recipient, a form such as that proposed could be used 
in conjunction with classroom visitation appraisals by 
heads of departments as well as publication accomplishments 
to assist in making decisions regarding promotions or 
tenure. 
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APPENDIX A 



B A L LOT 



PART A - STATISTICAL (ENCIRCLE APPROPRIATE CODE IN EACH SECTION) 

VOTER CATEGORY 



S STUDENT 



A ALUMNUS 



F FACULTY 



C CURRICULAR OFFICER 



STUDENT/ ALUMNUS/ CURRICULAR OFFICER 
Military 

Branch of Service Rank 



Curricular Area 



FACULTY 



Rank 



Department 



N 


Navy 


01 


30 


Ops Analysis 


IR 


Instructor 


AE 


Aeronautics 


M 


Marine Corps 


02 


31 


Aero Eng 


AT 


Assistant Prof. 


AO 


Aviation Safety 


A 


Army 


03 


32 


Elec & Comm Eng 


AC 


Associate Prof. 


MN 


Bus Ad & Econ 


c 


Coast Guard 


OU 


33 


Phys Sci & Sys Tech 


RP 


Professor 


GH 


Govt & Humanities 


L 


Air Force 


05 


34 


(Formerly Ordnance) 






MA 


Math 


F 


Foreign 


06 


Naval Eng & Eng Sci 






ME 


Mech Eng 


X 


Civilian 


07 


35 


Env Sci 






MR 


Meteorology 








36 


Mgmt & Compt Sci 






OC 


Oceanography 








38 


Baccalaureate 






OA 


Ops Analysis 








39 


Der Mariagement 






fH 


Physics & Chem 



KS Navy Mgmt Sys 



PART B - NaHNATIONS (INSERT A FOUR DIGIT FACULTY IDENTIFICATION NUMBER IN EACH BLAl^K) 



FIRST CHOICE 



SECOND CHOICE 



THIRD CHOICE 



PART C - LIST OF ELIGIBLE FACULTY (ALL FACULTY WHO HAVE TAUGHT TWO OR MORE COURSE SEGMENTS IN CALENDAR YEAR 1972 , 
EXCEPT CURRICULAR AND LIAISON OFFICERS AND MEMBERS OF THE SELECTION COMMITTEE) 



AVIATION SAFETY PROGRAMS 
10 l 4 Bomberger, R. B. 
1025 Bradbury, C. M. 

5016 Branson, J, J. 

5544 Nielsen, J. C. 

1047 Wible, L. C. 
DEPARTMENT OF AERONAUTICS 

1058 Ball, R. E. 

5027 Bank, M. H. 

5450 Bell, R. W. 

1069 Bennett, J.A.J, 

1070 Biblarz, 0 . 

1081 Collins, D, J. 

5472 Evans, R. M. 

5038 Fuhs, A. E. 

1092 Gawain, T. H. 

5049 Hess, R. A. 

1119 Kahr, C. H. 

1120 Layton, D. M. 

1131 Lindsey, G. H. 

1142 Miller, J. A. 

1153 Netzer, D. W. 

5050 Power, H. L. 

U 75 Redlin, M. H. 

1186 Schmidt, L. V. 

5461 Shreeve, R, P. 

1197 Vavra, M. H. 

1203 Zucker, R. D. 



DEPARTMENT OF ELEC. ENGR. 


1797 


She ingold, A. 


5144 


Brubaker, R. H. 


l 48 l 


Adler, R. W. 


1803 


Smith, W. C. 


2167 


Budway, J. J. 


5061 


Bach, R. 


I 8 l 4 


Spaugy, D. A. 


2189 


Chewning, W. C. 


1519 


Baycura, 0 . M. 


1825 


Stentz, D. A. 


2190 


Comstock, C. 


1531 


Boxildry, J. M. 


1836 


Strum, R. D. 


2206 


Davis, D. L. 


1542 


Breida, S. 


1847 


Terman, F. W. 


2217 


Dixon, D. R. 


1564 


Chan, S. 


1850 


Thaler, G. J. 


2228 


Estell, R. J. 


1586 


Cooper, P. E. 


1869 


Titus, H. A. 


2239 


Faulkner, F, D, 


1597 


Cotton, M, L. 


1870 


Turner, J. B., Jr. 


2240 


Franke, R. 


1625 


Ewing G. D. 


5438 


Wang, C. C. 


2251 


Giarratana , j. 


16U7 


Geist, «J • M« 


1881 


Ward, J. R, 


2262 


Gibbons, G. D 


1658 


Gerba, A., Jr. 


1892 


Wilcox, M. L. 


4091 


Hanna, R. M. 


1669 


Houston, R, K. 


DEPARTMENT OF GOVT & HUMANITIES 


2295 


Jayachandran, T, 


1670 


Kirk, D. E. 


1919 


Amos , J . W. , II 


2301 


Jennings, W. 


1681 


Klamm, C. F.,Jr. 


1931 


Boggess, W. C. 


2312 


Klldall, G. A. 


4035 


Knorr, J, B. 


1920 


BJarnason, L, L. 


2323 


Kodres, U. R. 


1692 


Mannont, G. H. 


5100 


Caldwell, D. E. 


2334 


Kolitz, B. L. 


1708 


Miller, R. L. 


1942 


Gabel, B. B. 


5166 


Kovach, L. D. 


5083 


Myers, H. L. 


1953 


Gottschalk, S. 


5511 


Logan, T. J. 


5449 


Ohlson, J. 


5250 


Huff, B. R. 


2367 


Lucas, K. R. 


1753 


Panholzer, R. 


5261 


Ross, G. A. 


2378 


Marks, H. B. 


4079 


Powers, J. P. 


1997 


Smith, B.M.L. 


2389 


Morris, G. W. 


4o8o 


Powers, V. M. 


DEPARTMENT OF MATHEMATICS 


5522 


Moore, L. R. 


5094 


Price, T. G. 


5500 


Bamford, R. C. 


2390 


Pierce, J. P. 


1764 


Rahe, G. A. 


2134 


Bender, A, P. 


2417 


Pulliam, F. M. 


1775 


Rothauge, C.. H. 


2145 


Bleick, W. E. 


5177 


Rice, B. 


1786 


Sackman, G. L. 


2156 


Bolles, R, C. 


2428 


Roberts, A. B. 
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DEPARTMENT OF MATHEMATICS 



5533 Russak, I. B. 

2439 Schoenstadt, A. L. 

2451 Shorb, A. M. 

2462 Singer, E. A, 

5188 Singer, S. 

2484 Stewart, E. J. 

2495 Stoops, G, A. 

2501 Syms, G. .H. 

2512 Trahan, D. H. 

2523 Wang, P. C. C, 

2534 Weir, M. D. 

2545 Wilde, C. 0 . 

DEPARTMENT OF MECHANICAL ENGR. 


2552 


Brock, J. E. 


2567 


Cantin, G. 


2578 


Cooper, T. E. 


5566 


Edwards, G. R. 


2589 


Garrison, G, J, 


2590 


Houlihan, T. M. 


2606 


Kelleher, M. D. 


2617 


Marto, P. J. 


5577 


McKinnon, E. A, 


2628 


Newton, R. E. 


2639 


Nguyen, D. H. 


5555 


Nunn, R. H. 


5588 


Perkins, A. J. 


2640 


Prowell, R. W. 


5199 


Pucci, P. F. 


2651 


Salinas, D. 


5200 


Sarpkaya, T. 


DEPARTMENT OF METEOROLOGY 


2673 


Alberty, R. L. 


2684 


Davidson, K, L, 


2712 


Elsberry, R. L. 


4107 


Haltiner, G. J. 


2723 


Hamilton, H. D. 


5211 


Haney, R, L. 


2745 


Martin, F. L. 


2756 


Oakes, W. B. 


4 ll 8 


Renard, R. J. 


2767 


Schardt, D. L. 


2778 


Taylor, C. L. 


5494 


Tracton, M. S. 


2789 


Van der Bijl, W. 


7001 


Williams, R. T. 


DEPARTMENT OF OCEANOGRAPHY 


2806 


Andrews, R. S. 


5272 


Bechelmayr, L. R. 


2828 


Boston, N. E. J. 


5222 


Bourke, R. H. 


2840 


Denner, W. W. 


2851 


Galt, J. A. 


2895 


Jung, G. H. 


4130 


Paquette, R. G. 


5244 


Roberts, C. K, 


2912 


Thompson, W. C. 


2923 


Thornton, E. B. 


2934 


Traganza, E. D. 


2956 


von Schvind, J. J. 


2967 


Wickham, J. B. 



DEPARTMENT OF OPS RES & ADM SC 
5311 Abbey, D. L. 

2978 Andrus, A. F. 

2989 Arima, J. K. 

0066 Barden, R. S. 

2990 Barr, D. R. 

0105 Bedow, R. J. 

3010 Brill, E. A. 

3021 Butte rworth, R, W, 

3032 Burnett, T. D. 

5355 Burns, D. C. 

30I43 Capra, J. R. 

121U Garrick, P. M. 

1225 Church, W. H. 

5283 Corcoran, A. W, 

0077 Courtney, D. 

4013 Creighton, J. W. 

3054 Cunningham, W. P« 

1247 Darbyshire , L. 

5333 DeMayo, P. 

1258 Eisenhardt, P. 

1269 Elster,R. S. 

3076 Esary, J. D. 

3098 Floyd, J. A. 

5399 Folsom, R. N. 

3115 Forrest, R. N. 

3104 Free, W. D. 

1270 Fremgen, J. J. 

•3126 Gaver, D. P. 

1292 Githens, W. H. 

1308 Grainger, T. L. 

3 i 48 Greenberg, H. 

5294 Haga, W. J. 

5300 Hampton, D. R. 

4091 Hanna, M. 

3160 Heidorn, G. E. 

3171 Higgins, J. E. 

0088 Horton, F. C. 

1319 Hoverland, H. A. 

3182 Howard, G. T. 

1320 Hyrnes, J. P. 

1331 Jolly, J. A. 

0099 King, G. J. 

3948 Kline, M. B. 

1353 Lande, R. S. 

1364 Lane, H. L. 

1375 Lee, M. H. 

4 l 4 l Lewis, P. A. W. 

3243 Undsay, G. F. 

3265 Marshall, K. T. 

1386 McDonald, J. H. 

3254 McMasters, A. W. 

3276 Milch, P. R. 

5405 Neil, D. E. 

5427 Overbay, W. A. 

3287 Peterson, C. A. 

3298 Poock, G. K. 

3304 Preston, F. L. 

0116 Rsike, W. M. 

3315 Richards, F. R. 

4046 Schneidevind, N. F. 

3326 Schrady, D. A. 



5366 Schumann, J, F. 

0127 Senger, J. D. 

3348 Shubert, B. 0 . 

3359 Shudde , R. H. 

5416 Smith, J. H. 

3360 Sovereign, M. G. 
i 425 Steckler, M. J. 

5322 Stephan, R. A, 

5377 Tate, T. 

3382 Taylor, J. G. 

5388 Terasawa, K. 

0149 Thomas, M. D. 

3409 Tyever, J. B. 

34 10 Washburn, A. R. 

1458 Wegener, W, H, 

0161 Weitzman, R, A. 

0172 Whipple, D. 

1470 Womer, N. K. 

5344 Zabrycki, E. A. 

3432 Zehna, P. W. 

3443 Zweig, H. J. 

DEPARTMENT OF PHYSICS & CHEM 
3454 Armstead, R, L. 

3465 Buskirk, F. R. 

3476 Ceglio, N. M. 

3487 Cooper, A, W. 

3498 Cooper, J. N. 

3504 Co^pens, A. B. 

3515 Crittenden, E, C., Jr, 
3526 Dahl, H. A. 

0183 Dally, E. B. 

3537 Eller, A. I. 

3548 Garrettson, G. A, 

3559 Hsndler, H. E. 

5483 HeiPri^ 0, 



3571 Kalmbach, S. H. 

3582 Kelly, R. L. 

0194 Maruyama, X. K. 

3621 Medvin, H. 

3632 Milne, E. A. 

3643 Neighbours, J. R. 

3654 Olsen, L. 0 . 

3665 Reese, W. 

2073 Reinhardt, R. A. 

2084 Reynolds, M. F, 

3687 Rodeback,G. W. 

2095 Rowell, C. F. 

3704 Schscher, G. E. 

5122 Schultz, J. W. 

3715 Schvirzke, F. R, 

2101 Sinclair, J. E. 

2112 Tolies, W. M, 

3726 Williamson, T. J. 

7012 Wilson, 0 . B. , Jr. 

3737 Woehler, K. E. 

3748 Zeleny, W. B. 

NAVY MANAGEMENT SYSTEMS CENTER 

3759 Blandin, S. W. 

3760 Boynton, R. E. 

0200 Callahan, J. F. 

0211 Campbell, W. A. 

3782 Childs, F. E. 

3793 Dawson, J. E, 

3810 Doran, E. J. 

5599 Ecker, H. P. 

3821 Freed, E. J. 

3854 Mauer, W. A. 

3898 Ulrey, I. W. 

3887 von Pagenhardt, R. 

3904 Wood, C, L. 



PART D - SUPPORTING REMARKS FOR YOUR PRIMARY NCMI NATION 
(OPTIONAL) 
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AWARD FOR EXCELLENCE IN TEACHING 



In order to augment the existing incentives for teaching of high 
quality, an Award for Excellence in Teaching has been established by the 
Superintendent, A substantial stipend was made possible through a gift 
to the Naval Postgraduate School Foundation in honor of Rear Admiral 
John J. Shieffelin, USN. The judgments of those who have participated 
in the educational processes at the Naval Postgraduate School are of 
primary importance in determining the recipients. This poll is being 
conducted to assess the collective opinion of students, facility, staff, 
and selected alumni. After accumulating and processing the voting 
results, the Selection Committee will make its recommendations to the 
Superintendent . 

A meaningful selection of the Award recipients is heavily dependent 
upon input from a large portion of the eligible voters . Your response 
is therefore earnestly requested. Please complete the enclosed ballot 
in accordance with the instructions below. The results of the polling, 
other than the name of the Award recipients, will be treated as 
privileged information. 



BALLOTING PROCEDURE: 



Step 1. Complete the information requested at the top (Part a) of the 
ballot. These items are for purposes of statistical analyses 
only. 

Step 2. On the list of eligible faculty (Part C) , encircle the four- 
digit identification number at the left of all those with whom 
you are sufficiently acquainted to make a judgment. If you have 
circled five or more numbers on the ballot, proceed to Step 3 « 
Otherwise, please return your ballot as directed in Step 5- 



Step 3. From the subset of faculty you have indicated in Step 2, select 
from one (l) to three (3) nominees. Indicate your preferences 
in order by'placing the four-digit identification numbers of 
your nominees for first, second and third choices in the appro- 
priate spaces provided in Part B . 

Step 4. You are invited to furnish a short statement in support of your 
primary nomination. Indicate those qualities which, in your 
judgment, make him an outstanding teacher. Space is provided 
for this at the end (Part D) of the ballot. 

Step 5- Place your conpleted ballot in the enclosed return envelope, 
sign the envelope and return. To be counted ballots must be 
received by 15 April 1973. Ballots will be separated from the 
envelopes. 
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NAVAL POSTGRADUATE SCHOOL 



MONTEREY. CALIFORNIA - 93940 



IN REPLY REFER TO: 



Dear Alumnus: 

This June awards for excellence in teaching for the third 
time will be given to members of our faculty, civilian or mili- 
tary* These will include the Rear Admiral John J. Shieffelin 
Award, made possible through a grant to the Naval Postgraduate 
School Foundation. Previous winners of the award are Professor 
John N. Dyer of the Department of Physics, Professor Eugene 
C# Haderlie of the Department of Oceanography and Assistant Pro- 
fessor Ronnie L. Alberty of the Department of Meteorology. The 
recipients are determined each year through a careful poll taken 
among alumni, students and faculty. 

In recognition of the fact that some of the qualities in- 
herent in teaching excellence may not be manifest to the student 
until certain experiences have been afforded in the field, we 
again seek an input to the poll from graduates. 

Your year group has been selected as one which should have 
had time to evaluate the quality of your instruction here without 
being too far removed to recall the experience clearly. 

Would you be kind enough to read the accompanying material 
and make your selections? It would be greatly appreciated. 



Sincerely 




S. Navy 



Superintendent 



Ends 
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MOVE THIRD TO THREE. 

IF THREE IS EQUAL TO SPACES THEN GO TC MOVE- 
MULTIPLY 3.0 BY A IN THIRD. 

MULTIPLY 5.0 BY B IN THIRD. 

ADD A IN THIRD, B IN THIRD, C IN THIRD GIVIN 
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DISPLAY BALLOT. 

IF NUMBER IN BALLOT IS EQUAL TO CHECK THEN 
GO TO FIND-NEXT-BALLOT-2. 

GO TO ENTRY-1. 
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APPENDIX C 



RANK-ORDERED ITEMS OF STUDENT EVALUATION 

B. r 
1 ic 

1. Interprets abstract ideas and theories clearly .038 

2. Gets students interested in his subject. .037 

3. Has increased my skills in thinking. .034 

4. Has helped broaden my interests. .031 

5. Stresses important material. .030 

6. Makes good use of examples and illustrations. .030 

7. Motivated me to do my best work. .029 

8. Inspires class confidence in his knowledge .029 

of the subject. 

9. Has given me viewpoints or appreciations. .029 

10. Is clear and understandable in his explanations. .028 

11. Seems to enjoy teaching. .028 

12. Has presented many thought-provoking ideas. .028 

13. Has given me new tools for attacking problems. .028 

14. Has made the course sufficiently difficult to .026 

be stimulating, 

15. Keeps the balance between discussion and lecture .022 

well suited to this type of course. 

16. Teaches near the class level. .022 

17. Has an adequate speaking voice. .022 

18. Makes the course practical. .022 

19. Shows interest and enthusiasm in his subject. .022 

20. Controls class discussion to prevent rambling .020 

and confusion. 

21. Has maintained an atmosphere of good feeling in .020 

the class. 
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22. Gives well organized lectures. 


.019 


23. Encourages initiative on the part of the 
students . 


.018 


24. Has a good sense of humor. 


.018 


25. Has been well prepared for each day's lecture. 


.017 
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